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We rigorously investigate the condition of time reversibility as well as detailed balancing for the 
second-order stochastic process with inertia. We show that the time-reversibility could not even 
guarantee the steady state to be at thermal equilibrium. The real thermal equilibrium demands the 
other condition of detailed balance regarding the interaction between the internal system and its 
contacting reservoir, i.e. agreeing with the Maxwell-Boltzmann velocity distribution. We show that 
frictional force naturally emerges as the only odd term of the force at thermal equilibrium when 
both conditions of detailed balance are satisfied. The two conditions correspond to two different 
previously reported entropy production rates respectively, followed by two equations of entropy 
balance. When the external force is only dependent on the spatial coordinates, the two entropy 
balance equations become the same. The entropy production rates of the second-order stochastic 
process and its corresponding overdamped first-order process without inertia are only consistent if 
there is no temperature gradient. In the presence of temperature gradient, we prove that the former 
must be at nonequilibrium (time-irreversible) , while the latter could still possibly be time-reversible. 



The principle of microscopic reversibility in thermody- 
namics states that the dynamic process of equilibrium 
ensembles is invariant with respect to the inversion in 
time [![. The meaning of such a time-reversibility is two 
folds: the forward trajectory X(t) and its time- reversed 
one X(— t) are both the solutions of a same determin- 
istic microscopic equations of motion, or the statistical 
descriptions of the forward and backward processes are 
exactly the same. In statistical mechanics, it is formu- 
lated in the second sense, and the principle of detailed 
balance and the Onsager reciprocal relations are both 
consequences of microscopic reversibility 

It is generally believed that time-reversibility of the 
statistical description for the process, or the detailed bal- 
ance, is equivalent to the thermal equilibrium, which has 
already been proved for chemical kinetics as well as over- 
damped Scholuchowski equations Also, the prin- 
ciple of microscopic reversibility for linear systems con- 
taining odd functions of velocities has been formulated 
by Casimir [l(| and developed by Onsager and Machlup 
11] half an century ago. These odd functions arise from 
the inertia of the system, which could be expressed as 
the time-derivatives of other even functions. 

Time-reversibility of second-order stochastic 
systems with inertia — In order to investigate the 
time-reversibility and its relation to thermal equilibrium 
for such a second-order system, we consider a general 
model describing the dynamics of single particle in the 
phase space 



d 2 X 

1 



which could be rewritten as the Langevin equation 

V: 



dX 

~~dt 
dV 



m- = F(X,V) 



(2) 



where £(t) represents Gaussian white noise with intensity 
D and m is the mass. It is also known as the Kramers' 
equation when F(X, V) = —r\V — \7xU(X), in which 
7] = 2 k nT . * s t ne frictional coefficient and U (X) is a po- 
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tential 

Hence the time-reversibility of such a stochastic sys- 
tem, is formulated as 

P(X(0) = Xl , V(0) = v 1: X(t) = x 2 , V(t) = v 2 ) 
= P(X(0) - x 2 , V(0) = -v 2 ,X(t) = x 1: V(t) = -vx), 

for any coordinates Xx,x 2l velocities V\,v 2 and time t. 
It follows that 

p {x 1 ,V 1 )p t (x 2 ,V 2 \x 1 ,V 1 ) 

= Po(x 2 ,-v 2 )p t (xx,-vx\x 2 ,-v 2 ), (3) 

where p (x,v) = P(X(0) = x, V(0) = v) is the initial 
distribution and 

Pt(x, v\x, v) 
= P(X(t) = x, V(t) = v\X(0) = 5, V(0) = v) 

is the transition probability density function. The condi- 
tion of microscopic reversibility formulated in connection 
to transition probabilities is firstly discovered by Tolman 

1- 

The time evolution of the function pt{x, v\x, v) obeys 
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both the Kolmogorov forward and backward equations: 



dp t (x,v\x,v) 
dt 



dpt(x,v\x, v) 
~dt 



'Fix v) 
-V« • (vpt) - V« • ( \J ' pt 



D 

2m 2 



„ F(cc,u) „ 

W • V^pt H V„Pf 

TO 

+ 7; — oV„ • V v pt- 

2m 2 



(4) 



(5) 



rewritten as 
— V^log p Q 

TO 

2Dv ■ V x log po 



Then we can apply these forward and backward equa- 
tions to derive the condition for time-reversibility. The 
time evolution of 

ft{x 2 ,v 2 ,x 1 ,vi) = r-Pt{xi, -Vi \X2,-v 2 ) 

Poix^V!) 

could be derived from the backward equation ([5]), i.e. 

prev 

m 



dt 



7 * 2 • (v 2 f t ) - V„ a • ( f t ) 



D 



V„ 2 • V„ 2 /t + S ■ ft, 



1™2 "2 v v 2 



where 

F rev ix 2 ,v 2 ) 
and 

S(x 2 , v 2 ) 



F(x 2 ,-v 2 ) 



D 



V„ 2 \ogp (x 2 , -V2) 



(v 2 p (x 2 , -v 2 )) + V„ 2 



F(x 2 ,v 2 ) 



p (x 2 ,-v 2 ) 



D 

'2m 5 



:V„ 2 • V V2 p (x 2 , -V 2 ) 



/p(x 2 , -v 2 ). 



According to the condition ([3]) of time-reversibility, 
ft(x 2 , v 2 ,x 1 ,v 1 ) = p t (x 2 ,v 2 \x 1 ,v 1 ), which should be the 
fundamental solution of the Kolmogorov forward equa- 
tion ((4]) . Hence the necessary and sufficient condition for 
time-reversibility is 



prev _ p. 
S(x 2 ,V 2 )=0. 



(6) 



The condition S(x 2 ,v 2 ) = just guarantees that the 
distribution po = p ss is the unique stationary solution to 
the well-known Fokker-Planck equation of the probability 
distribution p t {x,v) in the phase space 



d 

TT.Pt = *x' J x \ v • J V: 

at 



(7) 



where the coordinate flux J x = vp t and the velocity flux 

Jv = _ 2^7? V ^*' 

Define another function eF(x,v), which reverses all 
the odd variables including v under the time rever- 
sal, then the condition ^ of time-reversibility could be 



F eF; 



D. 



F - (eF) 2 + — V„ • (F + eF) 



(8) 



Furthermore, it is easy to prove that the coordinate 
fluxes are odd while the velocity fluxes are even with 
respect to all the odd variables including v in the case of 
time-reversibility, i.e. 



Jx — ( '1 > 

Jv — • V • 



(9) 



Hence the total observed fluxes in the subspaces of coor- 
dinates J J x dv vanishes. 

It could be regarded as the condition of detailed bal- 
ance, which is quite different from that of the overdamped 
Langevin dynamics 7] . In steady state, the condition Q 
of detailed balance is equivalent to the condition of time- 
reversibility ([8]). 

Time-reversible stationary distribution and an- 
other condition of detailed balance — Interestingly, 
a lot of steady-state probability density p ss could satisfy 
the time-reversibility condition ([SJ for certain force F. 
It is because once we have a well defined density func- 
tion p ss , then we could find an odd and an even function 
/i(= — e/i) and f 2 {= ef 2 ), which are the solution of the 
equations 



D 



V„log P ss = / i; 



2mvV x p ss = -V v -{f 2P ss )- 



(10) 



The even function f 2 is not generally unique, since we 
can add any magnetic term B x v to f 2 in which B is 
also odd under time reversal. Then F = f 1 ^ 2 would 
make the second-order stochastic process ((J) become 
time-reversible . 

The simplest analytical example is the AFM (atomic 
force microscopy) experiment performed on nanodevices 
14l Il5j . in which a linear velocity-dependent feedback 
control is applied. To be more precise, F = —t]V — 
otv — V x U(x) with a positive constant a. The cor- 
responding stationary distribution is Cexp[— (^mv 2 + 
U{x))/kBT e ff], in which the effective temperature 

It is easy to check that the condition © of time- 
reversibility is satisfied in its steady state, where F ~^ eF = 
— (77 + a)v. However, the effective temperature T e ff — 
— 7— T is less than the temperature T of the heat reser- 
voir, which implies that it is not in thermal equilibrium 
and heat flows from the reservoir to the internal system 
and then be released to the external agent in the form 
of work. Thus we realize that there is another condi- 
tion of detailed balance beyond the time-reversibility of 
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the internal stochastic process in order to guarantee the 
thermal equilibrium. 

When there is no external feedback of velocity in the 
AFM experiments, i.e. a = 0, the stochastic process is 
in equilibrium with stationary distribution p ss (x,v) oc 

lmv*+U(w)-i 



exp[ 



k B T 



'-}, i.e. T« 



eff 



T. 



The thermal contact between the internal stochastic 
dynamics (JlJ with its heat reservoir is due to the col- 
lisions between the internal single particle and the large 
number of equilibrium-fluctuating molecules in the reser- 
voir. Thus the principle of detailed balance for collisions 
tells that [H Ell 



(11) 



in which p ss (v) is the Maxwell velocity distribution of 
the reservoir, and the kinetic energy should be preserved 
during the collision, i.e. m v\+mv 2 = m (v 1 ) 2 +m(v 2 ) 2 , 
where m is the mass of the molecule in the reservoir. 
Hence 

p ss (x,v 2 ) _ p 38 ^) 



p ss (x,v' 2 ) P ss (vi) 



,J 2 



followed by 



p ss (x,v) = C(x)e 



(12) 



It is just the well-known Maxwell-Boltzmann velocity 
distribution, which could be rewritten as 



k R T. 



-V v logp ss = -v. 



(13) 



Therefore, a steady state is at thermal equilibrium if 
and only if both ([8|) and (fl3|) are satisfied, i.e. 



D. 



-V„ logp s 



eF 



D 



(14) 



Thus at thermal equilibrium, F could be naturally de- 
composed into an odd term — 2 k B T v an< ^ an even term 
F+ 2 F ■ Note that the only odd term is actually the fric- 
tion force — rjv. 



C exp(- 



In thermal equilibrium, p ss - * , 7 
and F = —tjv — V x U(x) + A(x,v) where A must 
be invariant under the inversion of time and satisfies 
V„ • (Ap ss ) = 0. For example, the Lorentz force 
A(x,v) = B x v in the electromagnetic field matches 
the requirement, because both the magnetic force B and 
the velocity v are odd functions under the inversion of 
time. 

Entropy production rates and the equations of 
entropy balance — Recently, a general definition of en- 
tropy production rate through comparison of the prob- 
abilities of the original path and its time-reversed path 



has been put forward and already applied to stochastic 
systems with odd and even variables [y, [13 1 . The entropy 
production rate is expressed as 



epr 



F — eF 



^V„log Pt 



ptdxdv. 



The entropy production rate epr is nonnegative. Accord- 
ing to the upper equation in (j8]), epr = is equivalent to 
the time-reversibility of the stochastic system provided 
that it is in steady state. 

The entropy of the stochastic system in the full phase 
space is defined as S = — J j pt(x, v) log p t (x,v)dxdv, 
hence the entropy balance equation is derived as 



dS 



J J [V x ■ J x + Vt, • J v ] log p t dxdv 
-J J [J v ■ V„ log p t ) dxdv 



epr - d e Si - d e S 2 , 



(15) 



where 



d e Si 



eF 



2m 



ptdxdv, 



and 



d e S 2 



eF 



F — eF 



ptdxdv. 



D 

2m 



V„ log p t 



On the other hand, according to the second condition 
of detailed balance ([TB")) . one can have another entropy 
balance equation [18j 



where 



epr 



dS_ 
~dt 



epr - d e S 1 - d e S 2 , 



(16) 



-rjv 



D 

2m 



V„ log p t 



ptdxdv, 



d e S 1 



rjv 



ptdxdv, 



d e S 



rjvpt 



D 
2m 



vdxdv. 



This second entropy production rate epr is nonnegative 
and epr = is equivalent to the condition (|13|) , which is 
usually not a consequence of (jHJ. An equilibrium state 
has to satisfy both of them, i.e. epr = together with 
epr = 0. 
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Actually, kpTd P S->. is just the heat dissipated into the 
heat bath [IjHl, i.e. 

k B TdTs 2 = -((-riv + Z{t))odx) 

D 



and 



iW + t^V-u logpt ) vp t dxdv 



Q(t). 



(17) 



And the work W(t) done by the control force F c - 
F + i]v is 

W(t) = ((F + £(t)) o dx) + Q(t) = (vo mdv) + Q(t) 

= J 1 1711 ^ v< ^ x< ^ v ~ Qft) 

F c vptdxdv, 



(18) 



which in steady state is equal to Q(t). 

In the steady state of the particles in the AFM exper- 
iment on nanodevices where F = —ryu — av — \7 x U(x), 

we have epf = n — r~. — T , d e S-i = n— , d e S 7 = ?°7 t , 

where n is the dimension of a; or d. Recall that k B T ■ 
d e S 2 — Q(t) is the heat towards the reservoir, therefore, 
d e Si could be regarded as the increase of the medium 
entropy due to the irreversible feedback procedure gen- 
erated by the external agent, and the steady-state en- 
tropy production rate epf = d e S 1 + d e S 2 is just the total 
entropy increase which is positive. 

Consistence and inconsistence with overdamped 
first-order process without inertia — When F = 
—r]v + G(x) where G{x) is the external force only depen- 
dent on the coordinates, these two kinds of entropy bal- 
ance equations (|15[) and (|16|) are equal. In this case, the 
condition of time-reversibility is equivalent to the steady 
state to be at equilibrium, which requires 



k B TV v log 
k B Tv- V x logp e9 



-rav; 
-v ■ G(x) 



It is easy to prove that it holds if and only if the external 
force G(x) having a potential and the temperature T is 
independent of x. 

When the frictional coefficient 77 is quite large, the 
stochastic dynamics in the coordinate subspace could be 
well approximated by the overdamped first-order process, 



i.e. the corresponding Smoluchowski equation |21l |2 



dX . 

v — = G(x) + at), 



(19) 



Furthermore, the distribution in the full phase space 
p t (x,v) could be approximated by q t (x,v) + w t {x,v) in 
such a overdamped situation 21], where 



qt(x,v) 



1 



2tt 



k B T 



sT Pt{x) 



w t (x,v) 



k B T 



-e (-G(x) + k B TV x )p t (x). 



n 



The pt{x) satisfies the Fokker-Planck equation for the 
Smoluchowski equation (flU)) [2ll. \22\. 
Hence 



v + 



= v 



k B T 



m 



k B T 


V„ log p t 










m 










k B T 


V„ log [q(x,v) - 


- w(x, v)] 






m 






k B T 


V„ log q( 


x, v) 4 




w(x 


V) 


m 


m 


q(x, 


v) 


r 


w(x, v) 












q(x, v) 











= -[G(x)-k B TV x \ogp t {x)] 



(20) 



since w(x,v) << q(x,v) when n is quite large. 

Then, the entropy production rate of the Langevin dy- 
namics 



epr 



epr — 



-W° - t^-V„ log Pt 



p t dxdv 

w J ^\G(x) - k B TV x \og pt(x)f p t (x)dx 
= epr, 

which is just the entropy production rate for the Smolu- 
chowski equation [7|. 

Moreover, the entropy of the Langevin dynamics in the 
full phase space 

S(t) = J J — pt(x, v) \ogp t (x, v)dxdv 

« — J J q t (x,v) log q t (x,v)dxdv 

f - / \ t » / % , n n , 2nk B T 

= / -Pt{x) logpt{x)dx + - 4- - log 

J 2 2m 

= S(t) + constant, 

which followed by dS(t) = dS{t). 

The condition of time-reversibility associated with the 
entropy production rate epr, is that the field fc ^^ hav- 
ing a potential Q- Therefore, in the absence of temper- 
ature gradient, the established theory of nonequilibrium 
thermodynamics for the Smoluchowski equation is 
consistent with that of the stochastic dynamics in the full 
phase space discussed in the present letter. 

However, in the presence of temperature gradient, 
the second-order stochastic process ([T]) is always time- 
irreversible, while the Smoluchowski equation (I19[) still 
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could be time-reversible, e.g. if x is one-dimensional. 
It is because the approximation (|20|) only considers the 
leading order. 

In conclusion, (i) we proposed two conditions of de- 
tailed balance for the stochastic system with inertia, (ii) 
Each condition corresponds to one equation of entropy 
balance. It clarifies the difference between two previously 
reported entropy production rates 13, 3]. (hi) For the 
Langevin equation taking the Smoluchowski equation as 
its overdamped limit, the two equations of entropy bal- 
ance are equal. It is consistent with that of the Smolu- 
chowski equation if there is no temperature gradient, but 
inconsistent in the presence of temperature gradient. 
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